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Abstract 

Prom direct observations of the longitudinal development of ultra-high energy air 
showers performed with the Pierre Auger Observatory, upper limits of 3.8%, 2.4%, 
3.5% and 11.7% (at 95% c.l.) are obtained on the fraction of cosmic-ray photons 
above 2, 3, 5 and 10 EeV (1 EeV = 10^^ eV) respectively. These are the first 
experimental limits on ultra-high energy photons at energies below 10 EeV. The 
results complement previous constraints on top-down models from array data and 
they reduce systematic uncertainties in the interpretation of shower data in terms 
of primary flux, nuclear composition and proton-air cross-section. 



1 Introduction 



Data taken at the Pierre Auger Observatory were searched previously for ultra- 
high energy (UHE) photons above 10 EeV [1,2]. In Ref. [1], the depth of shower 
maximum XmaxOf air showers observed by fluorescence telescopes in hybrid 
mode (i.e. with additional timing information from the ground array) was used 
to place an upper limit of 16% on the photon fraction above 10 EeV, confirming 
and improving on previous limits from ground arrays [3,4,5,6]. In Ref. [2], the 
larger number of events taken with the Auger ground array alone allowed us 
to place a limit of 2% above 10 EeV, which imposes severe constraints on 
"top-down" models for the origin of ultra-high energy cosmic rays. 

Observations in hybrid mode are also possible at energies below 10 EeV. De- 
creasing the energy threshold increases the event statistics, which to some 

extent balances the factor ~10 smaller duty cycle compared to observations 
with the ground array alone. Thus, based on the previous work, the search 
for photons is now extended to lower energy (here down to 2 EeV). We also 
improve on our previous (statistics-limited) bound above 10 EeV from Ref. [1]. 
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Photons at EeV energies are expected to be produced in our cosmological 
neighborhood, as the energy attenuation length of such photons is only of 
the order of a few Mpc. Possible sources of EeV photons are the standard 
GZK process (see e.g. Refs. [7,8,9]), the production by nuclei in regions of 
intense star light (e.g. in the galactic center [10]), or exotic scenarios such 
as top-down models (see Ref. [11] for a review). Compared to our previous 
constraints on top-down models from Ref. [2], the bounds derived in this work 
provide a test of model predictions in a different energy range and using a 
different experimental technique, thus giving an independent confirmation of 
the model constraints. 

Limits on EeV photons reduce corresponding systematic uncertainties in other 
analyses of air shower data. For instance, the presence of a substantial photon 
component can severely affect the reconstruction of the energy spectrum [12], 
the derivation of the proton-air cross-section [13,14], and the interpretation of 
the observed average Xmax [15] in terms of a nuclear primary composition. 

The structure of the paper is as follows. In Section 2 the analysis is described 
and applied to the data. The results are discussed in Section 3. 



2 Data and Analysis 

The present analysis follows closely the one described in detail in Ref. [1] 
which is called Hybrid-1 below. The basic idea is to compare the measured 
Xjnax values to those expected for primary photons, because UHE photon 
showers have significantly deeper average Xmax • We provide a summary of 
the analysis method, paying special attention to differences or changes in the 
approach compared to Hybrid-1. 

The data used here were taken with a total of 18 fluorescence telescopes lo- 
cated at three sites ( "Los Leones" , "Los Morados" and "Coihueco" ) between 1 
December 2004 and 31 December 2007. The number of ground stations grew 
in this period from about 530 to 1450. Compared to Hybrid-1 the data set 
above 10 EeV increased in size by a factor ~2.2. 

The event reconstruction [16] is based on an end-to-end calibration of the 
fluorescence telescopes [17], monthly models for the atmosphere [18], and an 
average aerosol model based on local atmospheric measurements [19]. The 
reconstruction of the longitudinal profile is described in [20]. A correction 
of ~ 1% for the missing energy (energy carried by neutrinos or high-energy 
muons) is applied to the reconstructed calorimetric energy, corresponding to 
the effective energy of primary photons [21]. 
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The following quality cuts are applied to the collected events: 



• number of phototubes in the fluorescence telescope triggered by the shower 
>6; 

• distance of closest approach of the reconstructed shower axis to the surface 

detector station with the largest signal is <1.5 km, and difference between 
the reconstructed shower front arrival time at this station and the measured 
tank time is <300 ns; 

• normalized Xprof of the longitudinal shower profile fit [20] <6, and ratio of 
Xprof to Xiine < 0.9, where Xime refers to a straight hne fit (the latter cut 
essentially rejects profiles with too few data points); 

• depth of shower maximum Xmax observed in the telescope field of view (this 
cut may be relaxed in future to allow also the search for deeply penetrating 
events with X^^x. beyond the field of view) ; 

• minimum angle between the viewing direction of a triggered pixel and the 
shower axis >15° (to reject events with a large Cherenkov hght contamina- 
tion); 

• primary energy E > f- EeV, / = 2, 3, 5, 10 (the analysis in Hybrid- 1 was 
restricted to / = 10). 

The criterion of Xmax being observed can introduce a bias against the deeply 
penetrating photon primaries (e.g. for near- vertical events). To reduce the 
dependence of the detector acceptance on composition, fiducial volume cuts 
are applied: 



shower zenith angle > 35° -|- gi{E) 
9i{E) = 



10 ° {IgE/eV - 19.0) for Ig E/eV < 19.7, 
7° for IgE/eV > 19.7; 



distance of telescope to shower core < 24 km -|- g2{E) 
92{E) = 



12 {\gE/cV - 19.0) km for IgE/eV > 19.0, 
6 {IgE/eV - 19.0) km for lgE/eV< 19.0. 



The described cuts are identical to those from Hybrid- 1 for showers >10 EeV, 
but allow now for an extension of the energy range down to 2 EeV. 

To evaluate the detector acceptance as a function of energy for different pri- 
mary particles, simulations have been performed using CORSIKA [22] with 
QGSJETOl [23] and FLUKA [24] as high- and low-energy hadronic interaction 
models respectively. The Monte Carlo showers have been processed through 
a complete detector simulation and reconstruction chain [16,25]. In Fig. 1 we 
show the energy-dependent relative exposure obtained after trigger, quality 
cuts, and fiducial volume cuts for primary photons, protons and iron nuclei 
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(normalized to 10 EeV protons). After fiducial volume cuts, the acceptance 
for photons is close to the acceptance for nuclear primaries. Thus, the rel- 
ative abundances of photon and nuclear primaries arc preserved to a good 
approximation. In a similar way to Hybrid-1, we apply, for the derivation of 
an upper limit on the photon fraction, an efficiency correction according to the 
acceptances after fiducial volume cuts which is conservative and independent 
of assumptions about the actual primary fluxes (factor "efvc" , see Appendix) . 

Applying the selection cuts to the data, there remain n[otai(-^uir) — 2063, 1021, 
436 and 131 events with energies greater than E'^^^ = 2, 3, 5 and 10 EeV re- 
spectively. The label 7 in E'^^^ indicates that the missing energy correction 
for photons has been applied. To obtain ntotai(-E'thr) from the total number 
of events ^^-totail-^Zhr) after fiducial volume cuts, those events need to be re- 
jected where clouds may have disturbed the observation. The presence of 
clouds could change the efficiencies which are shown in Fig. 1. Also, the recon- 
structed Xmax values may be affected. Particularly, clouds may obscure early 
parts of the shower profile such that the remaining event profile looks deeply 
penetrating and, hence, photon-like. Therefore we only use data where any 
disturbance by clouds can be excluded using information from the IR cloud 
monitoring cameras [26,27]. In Hybrid-1 all events were individually checked. 
As this is hardly feasible for the events in the present data set (a full automatic 
processing of cloud data is in preparation), the following approach is adopted. 
To determine the efficiency edc of passing the cfoud cut we used the sample of 
events with energy above 10 EeV. Accepting only events where any disturbance 
by clouds could be excluded, 67 events out of 131 have been selected, corre- 
sponding to ecic — 0.51. We confirmed that this efficiency also holds at lower 
energy by applying the same criteria to a sub-set of ~300 events at ~3 EeV. 
The final number of ntotai(-£^thr) is then given by ntota^-E^tlr) = •r^[otal(-E^thr)■ 
As the present data set above 2 EeV is about a factor ~15 larger than the 
one used in Hybrid-1, a different statistical method is applied to derive the 
photon limit. For the derivation of the limit in Hybrid-1, each selected event 
was individually compared with high-statistics photon simulation, using the 
respective primary energy and direction as simulation input. This method is 
CPU demanding, and tailormade for a relatively small number of events. We 
therefore adopt for our analysis the method applied in Ref. [2] which needs as 
an input the total number of events, the number of photon candidates (events 
having "photon-like" characteristics, see below) and proper correction factors 
accounting for inefficiencies. The 95% c.l. upper limit F^^^{Eth_r) on the fraction 
of photons in the cosmic-ray fiux above i?thr is then given by 



„95 ( pi \ 
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Fig. 1. Relative exposure to primary photons, protons and iron nuclei, normalized to 
protons at 10 EeV. Top panel requiring hybrid trigger, center panel after applying 
quality cuts, bottom panel after applying fiducial volume cuts (see text). In order 
to guide the eye polynomial fits are superimposed to the obtained values. 



where ^^^^and ^5% c.l. upper limit on the number of photon candidates 

and ntotai the total number of selected events. As it is not known in advance 
whether photons indeed compose only a negligible fraction of the cosmic-ray 
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Fig. 2. Closeup of the scatter plot of X^ax vs. energy for all events (blue dots) 
with Xmax above 800 gcm~^ and energy above 2 EeV, after quahty, fiducial volume 
and cloud cuts. Red crosses show the 8 photon candidate events (see text). The 
solid red line indicates the typical median depth of shower maximum for primary 
photons, parameterized as X2i^'^ = a ■ y + b, foi y = lg(£'/EeV), y = [0, 1.2], where 
a = 100 g cm~^ and b = 856 g cm~^ . The dashed blue line results from simulations 
of primary protons using QGSJET 01. A fraction of 5% of the simulated proton 
showers had X^ax values larger than indicated by the line. 



flux, we apply the missing energy correction appropriate for photons to all 
events and take here ntotai(-E'7hr)- This is conservative (larger value of F^^), 
since using the missing energy correction for hadrons (factor ~ 1.07 — 1.14 
[28,21]) would increase the total number of events above -Ethr, i-e. ntotaK-Ej^J < 

A scatter plot of Xmax vs. energy for all events above E'^^j.=2 EeV with Xmax > 
800 gcm~^ surviving quality, flducial volume and cloud cuts is shown in Fig. 2. 
Statistical uncertainties in individual events are typically a few percent in 
energy and ~ 15 — 30 gcm~^ in X^ax • Systematic uncertainties are ~ 22% in 
energy [29] and ~ 11 gcm~^in X^ax [15]. 

The upper limit on the number of photon candidates ^^^cand is given by 
^7-cand = ^7-cand,obs/eobs, whcrc n^^.^and.obs IS the 95% c.l. uppcr limit on 
the number of photon candidates ^^-cand.obs extracted ( "observed" ) from the 
data set and eobs is the corresponding efficiency, ^^7-cand,obs is taken as the 
number of events which have the observed X^ax above the median X^^'^ of 
the distribution expected for photons of that energy and direction ("pho- 
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slant depth [g cm"^] x„„ [g cm""] 



Fig. 3. Left panel: shower profile (black bullets) of the deepest X^ax candidate event 
in the analyzed sample (id 3554364), along with the Gaisser-Hillas fit (red line). 
Right panel: the observed Xmax value (black arrow) along with the Xmax distribution 
from the dedicated photon simulation (histogram); see Tab. 1 for statistical uncer- 
tainty. The dashed line indicates the median of the photon distribution. 

ton candidate cut"). Additionally, on these particular events individual cloud 
checks have been performed, and only events that pass this cloud check are 
finally considered as photon candidates. In Fig. 2, typical values of X^^'^ (E) 
are indicated as a function of energy (solid red line). To extract the specific 
value of X^'^'^'^for each individual event, dedicated simulations with primary 
photons have been performed for all potential candidate events, assuming the 
corresponding energy and geometry. 

There are ri-y-cand.obs = 8, 1, 0, photon candidate events with energies greater 
than 2, 3, 5 and 10 EeV, respectively. These candidate events are marked 
by red crosses in Fig. 2 and the event parameters are listed in Table 1. As 
an illustration, the shower profile of the candidate with the deepest Xmaxis 
displayed in the left panel of Fig. 3; in the right panel the measured Xmax value 
is shown along with the results of the dedicated photon simulations. 

We checked with simulations whether the observed number of photon candi- 
date events is significantly larger than the expectation in case of nuclear pri- 
maries only, i.e. whether primary photons appear to be required to explain the 
photon candidates. The quantitative estimation of the background expected 
from nuclear primaries suffers from substantial uncertainties, namely the un- 
certainty of the primary composition in this energy range (a larger background 
to photons would originate from lighter nuclear primaries) and the uncertainty 
in the high-energy hadronic interactions models (for instance, reducing the 
proton-air cross-section allows proton primaries to penetrate deeper into the 
atmosphere). From simulations using QGSJETOl as the hadronic interaction 
model, we found that the observed number of photon candidate events is well 
within the number of background events expected from a pure proton and a 
pure iron composition. For energies larger than 2 EeV about 30 events are 
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expected in the analyzed time window for proton and 0.3 for iron. The cor- 
responding numbers above 3, 5, 10 EeV are about 12, 4, 1 events for proton 
and about 0.2, 0.1, 0.0 events for iron. Scenarios of a mixed composition, as 
also favored by our results on <Xmax > [15], can reproduce the observation. 
We conclude that the observed photon candidate events may well be due to 
nuclear primaries only. This also holds for the candidate event with the largest 
Xmax shown in Fig. 3: proton showers with comparable or larger Xmax value 
occur at a level of a few out of thousand simulated events. 

We now continue to derive the upper limit to the photon fraction. JT-^^cand.obs 
is calculated from n-y_cand,obs using the Poisson distribution and assuming no 
background, i.e. n^-cand.obs is not reduced by subtracting any event that may 
actually be due to nuclear primaries. This procedure represents the most con- 
servative approach as it maximizes the value of JT-^^cand.obs- The efficiency eobs 
of photons passing all cuts is given by eobs = efvc^pcc where efvc ~ 0.72 — 0.77 
(see Tab. 2) comes from the acceptance after fiducial lolume cuts (see Ap- 
pendix) and, by construction, epcc = 0.50 is given by the photon candidate cut 
above the median of the Xmax distribution for photons. Thus, the upper limit 
is calculated according to 



"■T-cand.obsV-^thr; ej^^ ^p^^ 



total (-^thr) ^clc 



(2) 



Applied to the data, upper limits of 3.8%, 2.4%, 3.5% and 11.7% on the 
fraction of cosmic-ray photons above 2, 3, 5 and 10 EeV are obtained at 95% 
C.I.. Table 2 provides a summary of the quantities used in the derivation of 
the integral upper limits. 

We studied the robustness of the results against different sources of uncer- 
tainty. Varying individual event parameters or the selection criteria, within the 

Table 1 

Characteristic parameters for the eight events surviving the photon candidate cut 
(AXmax refers to the statistical uncertainty). 



id 


-'^max [gCm-2] 




[EeV] 


2051232 


923 


17 


2.5 


2053796 


905 


32 


3.1 


2201129 


958 


29 


2.3 


2566058 


908 


20 


2.1 


2798252 


937 


29 


2.9 


3478238 


984 


12 


2.4 


3554364 


1042 


12 


2.5 


3690306 


912 


27 


2.5 
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Table 2 

Summary of the quantities used in the derivation of the integral upper limits on 
the photon fraction for E^^^ = 2, 3, 5, and 10 EeV. Not listed are the efficiencies 
^cic = 0-51 and epcc = 0.50 which do not depend on E2 



EL [EeV] 


^7— candjObs 


„95 
7— cand,obs 


""total 


efvc 




2 


8 


14.44 


2063 


0.72 


3.8 


3 


1 


4.75 


1021 


0.77 


2.4 


5 





3.0 


436 


0.77 


3.5 


10 





3.0 


131 


0.77 


11.7 



experimental resolution, leaves the results essentially unchanged. Uncertain- 
ties in the determination of the efficiency factors used in Eq. 2 are estimated 
to correspond to an uncertainty AF^^/F^^ ~ 0.15. Increasing (reducing) all 
reconstructed Xmax values by AX^|^ = 11 gcm~^ [15] changes the number of 
photon candidates above 2 EeV by +1 (±0) and above 3 EeV by ±0 (— 1), 
while it does not affect the higher energies. The limits then become 4.1% 
(3.8%) above 2 EeV and 2.4% (1.5%) above 3 EeV. The energy scale Ethr 
which the limit F^^(Ethr) refers to, has a 22% systematic uncertainty [29]. 
Hence, the numerical values of the hmits F^^ derived here refer to an effec- 
tive energy threshold E^^^. ~ x ^'thr, with — 0.78. ..1.22. Related to an 
increase (reduction) of the energy scale is a small upward (downward) shift of 
the Xmax value used for the photon candidate cut, leading to stronger (weaker) 
criteria for an event to pass this cut. This shift amounts to ~7 gcm~^ for a 22% 
change of the energy scale. Finally, an uncertainty <10 gcm~^on the simu- 
lated photon Xniax values comes from the need to extrapolate the photonuclear 
cross-section to high energy [30]. Adding in quadrature the discussed uncer- 
tainties in Xmax gives an effective total uncertainty of ~16 gcm~^ . Increasing 
(reducing) all reconstructed X^ax values by this amount changes the number 
of photon candidates above 2 and 3 EeV by -|-3 (±0) and by (—1). Ac- 
cordingly the limits then become 4.8% (3.8%) above 2 EeV and 3.1% (1.5%) 
above 3 EeV, while the limits above 5 and 10 EeV are unchanged. 



3 Discussion 

The derived upper limits are shown in Fig. 4 along with previous experimental 
limits and model predictions (see Ref. [34] for a review and references). These 
new bounds are the first ones at energies below 10 EeV and, together with 
Hybrid-1, the only ones obtained so far from fiuorescence observations (all 
other limits coming from ground arrays). The results complement the previous 
constraints on top-down models from Auger surface detector data. It should 
be noted that due to the steep flux spectrum, even the previous Auger bound 
of 2% above 10 EeV only marginally constrains the photon contribution above 
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10^^ 10^" 

threshold energy [eV] 



Fig. 4. Upper limits on the photon fraction in the integral cosmic-ray flux for dif- 
ferent experiments: AGASA (Al, A2) [3,4], AGASA- Yakutsk (AY) [31], Yakutsk 
(Y) [32], Haverah Park (HP) [5,6]. In black the limits from the Auger surface detec- 
tor (Auger SD) [2] and in blue the limits above 2, 3, 5, and 10 EeV derived in this 
work (Auger HYB). The shaded region shows the expected GZK photon fraction as 
derived in [7]. Lines indicate predictions from top-down models, see [8,33] and [34]. 

lower threshold energies (for instance, even above 5 EeV, ~75% of the events 
are in the previously untested energy range of 5—10 EeV). 

The photon limits derived in this work also help to reduce certain systematic 
uncertainties in other analyses of air shower data such as (i) energy spectrum: 
the Auger method of reconstructing the energy spectrum does not suffer from 
a large contamination from photons at EeV energies; (ii) nuclear primary 
composition: the interpretation of observables sensitive to the primary parti- 
cle (for instance the observed average X^^x ) in terms of a nuclear primary 
composition can only be marginally biased by contributions from photons; (iii) 
proton-air cross-section: the possible contamination from photons was one of 
the dominant uncertainties for deriving the proton-air cross-section [13,14], 
and this uncertainty is now significantly reduced (to ~50 mb for data at EeV 
energies, which corresponds to a relative uncertainty of ~10%). 

In future photon searches, the separation power between photons and nuclear 
primaries can be enhanced by adding the detailed information measured with 
the surface detectors in hybrid events. For an estimate of the future sensitivity 
of Auger to photons see Ref . [34] . The information on event directions can also 
be used in future analyses; for instance, an excess flux of photons from the 
direction of the galactic center (e.g. Ref. [10]) can be searched for. 
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A Acceptance correction 



The fraction of photons fj in the cosmic-ray flux integrated above an energy 
threshold E'thr is given by 

/ %{E)dE 

where ^■^/{E) denotes the differential flux of photons and ^i{E), i — p, He, ... 
the fluxes of nuclear primaries. 

The fraction of photons /^^* as registered by the detector is given by 

H.. s If AJE)%{E)dE , ^ 



with Aj(E) and Ai[E) being the detector acceptances to photons and nuclear 
primaries, respectively. E^ denotes the effective threshold energy for primary 
nucleus i. 

Thus, the upper limit /^''^^* obtained to the registered data, f^^''^^^ > /^^*, 
needs to be corrected to resemble an upper limit on the fraction of photons 
in the cosmic-ray flux. For the present analysis, a conservative and model- 
independent correction is applied as follows. The approach adopted here ex- 
tends the one introduced in Hybrid- 1, as we now also treat the case of A^{E) ^ 
const. 

£^thr corresponds to the analysis threshold energy assuming primary photons. 
Ei is related to E^^^ by the ratios of the missing energy corrections rrij (for 
photons) and (for nuclear primaries), 

Ei = £;thr ■ — . (A.3) 

Since ~ 1.01 [21] and ~ 1.07-1.14 [28], E^ > ^thr- Thus, replacing E^ 
by Ethv, 



/^^^^ A,{E)^,{E)dE + E^ Ie,,^ A{E)^,{E)dE 

> Ie... Ar^.{E)dE 

- Jj,^^^ Af-^,{E)dE + E. /e,,, A,{E)^,{E)dE ' ^ ' > 



where A™™ refers to the minimum value of A^{E > -Ethr) and using a/{a-\-b) > 
a' /{a' + 6) for a > a' > and 6 > 0. 
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Next, the acceptance ratio = is introduced, 



CiE > Ethr) > ' ' . (A.5) 

Ie,.. Ar%{E)dE + /^,,, ^)UE)dE 

From Fig. 1 the minimum acceptance ratio emin(-Ethr) < ^i{.E > -Ethr) can be 
extracted for each threshold energy -Ethr- In the current analysis, emin(-£'thr) = 
efvc(^thr) ^ 0.72,0.77,0.77,0.77 for Ethr = 2, 3, 5, 10 EeV. Hence, it follows: 



f^'\E>E,^,)> 



Ie,,. %{E)dE + Ie,,^ HE)dE 



Ie ^-i{.E)dE 

where it was used that — — r > 1. 

Consequently, an upper limit F"^ to the fraction of photons in the cosmic-ray 
flux can conservatively be calculated as 

^ul ^ /ul.dct/^^^^ ^ ^det/^^^^ > (A.7) 



The upper limit obtained this way does not depend on assumptions about the 
differential fluxes ^^{E) and ^i{E). 
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